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5 CROSS-REFERENCE TO RELATED APPLICATIONS 

This application claims the benefit of U.S. Provisional Application No. 
60/190,579, filed March 20, 2000, and entitled "AUTOMATIC DIRECTIONAL 
PROCESSING IN MULTI-MICROPHONE SYSTEM", the contents of which is 
hereby incorporated by reference. This application is also related to (i) U.S. 
10 Application No. 09/788,271, filed February 16, 2001, and entitled "NULL 
ADAPTATION IN MULTI-MICROPHONE DIRECTIONAL SYSTEM", the 
contents of which is hereby incorporated by reference; and (ii) U.S. Application 

No. 09/ , filed March 14, 2001, and entitled "ADAPTIVE MICROPHONE 

MATCHING IN MULTI-MICROPHONE DIRECTIONAL SYSTEM", the contents 



>f> 15 of which is hereby incorporated by reference. 



BACKGROUND OF THE INVENTION 

1. Field of the Invention 

The present invention relates to multi-microphone sound pick-up 
20 systems and, more particularly, to directional processing in multi-microphone 
sound pick-up systems. 

2. Description of the Related Art 

Suppressing interfering noise is still a major challenge for most 
communication devices involving a sound pick up system such as a 
25 microphone or a multi-microphone array. The multi-microphone array can 

selectively enhance sounds coming from certain directions while suppressing 
interference coming from other directions. 

FIG.1 shows a typical directional processing system in a two- 
microphone hearing aid. The two microphones pick-up sounds and convert 
30 them into electronic or digital signals. The output signal from the second 
microphone is delayed and subtracted from the output signal of the first 
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microphone. The result is a signal with interference from certain directions 
being suppressed. In other words, the output signal is dependent on which 
directions the input signals come from. Therefore, the system is directional. 
The physical distance between the two microphones and the delay are two 
5 variables that control the characteristics of the directionality. For hearing aid 
applications, the physical distance is limited by the physical dimension of the 
hearing aid. The delay can be set in a delta-sigma analog-to-digital converter 
(A/D) or by use of an all-pass filter. 

Although the typical directional processing system, such as shown in 
10 FIG. 1 , is able to suppress interference from certain directions, the typical 

directional processing also has some disadvantages. One disadvantage is that 
the frequency response of the typical directional processing system is like a 
high-pass filter, with low frequency components attenuated more than high 
frequency components. This is so-called a low frequency roll-off phenomenon. 
15 Another disadvantage is that the noise floor of the typical directional processing 
system is higher than with a single microphone. This is because each 
microphone has a noise floor. The typical directional processing system has 
more than one microphone and the combined noise floor of two microphones is 
always higher than that of a single microphone. Accordingly, it is desirable to 
20 turn-off the directional processing during quiet periods to avoid these two 
disadvantages. 

Most existing hearing aids that perform directional processing provide a 
manual means for users to turn the directional processing on or off. Recently, 
U.S. Patent 5,214,709 proposed a method to turn the directional processing 

25 on/off simply based on the level of the microphone response. One problem 
with such a design is that the turning of the directional processing on/off is not 
based on whether the environment is noisy or quiet. As a result, high-level 
clean speech could trigger the directional processing even though unwanted. 
Further, because the triggering of directional processing is simply based on a 

30 voltage level of the microphone response, the fluctuation in speech signal could 
undesirably turn the directional processing on and off, which is very annoying 
for users. 



Att.Dkt.No.: AUD1P006 



2 



* # 

Thus, there is a need for improved approaches to control directional 
processing in multi-microphone processing systems. 



SUMMARY OF THE INVENTION 

5 Broadly speaking, the invention relates to improved approaches to 

control directional processing in multi-microphone processing systems. These 
approaches operate to control activation/deactivation of directional processing 
in multi-microphone processing systems. As a result, directional processing 
can be automatically activated or deactivated based on the amount of 
10 interference (e.g., noise) in a listening environment. These approaches are 
particularly useful for hearing aid applications in which directional noise 
S suppression is important. 

*f1 The invention can be implemented in numerous ways including as a 

W method, system, apparatus, device, and computer readable medium. Several 

y 15 embodiments of the invention are discussed below. 

^ As a directional sound processing system, one embodiment of the 

m invention includes at least: at least first and second microphones spaced apart 

jj? by a distance, the first microphone producing a first electronic sound signal and 

P the second microphone producing a second electronic sound signal; a noise 

3 20 level estimate circuit operatively coupled to the first or second microphone, the 

noise level estimate circuit operates to produce a noise level estimate 
associated with the first or second electronic sound signal from the first or 
second microphone; and a directional processing circuit operatively connected 
to the first and second microphones and the noise level estimate circuit, the 
25 directional processing circuit operates to activated or deactivate directional 

processing with respect to the first and second electronic sound signals based 
on the noise level estimate. 

As a directional sound processing system, another embodiment of the 
invention includes at least: at least first and second microphones spaced apart 
30 by a distance, the first microphone producing a first electronic sound signal and 
the second microphone producing a second electronic sound signal; a 
minimum estimate circuit operatively coupled to the first or second microphone, 
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the minimum estimate circuit produces a minimum estimate for the first or 
second electronic sound signal from the first or second microphone; a 
directional processing control circuit operatively coupled to the minimum 
estimate circuit, the directional processing control circuit produces a control 
5 signal based on the minimum estimate; and a scaling circuit operatively 
connected to the directional processing control circuit, the scaling circuit 
operates to scale the second electronic sound signal in accordance with the 
control signal; and a subtraction circuit operatively connected to the scaling 
circuit and the first microphone, the subtraction circuit producing an output 
10 difference signal by subtracting the scaled second electronic sound signal from 
the first electronic sound signal. 

As a hearing aid device having a multi-microphone sound processing 
*0 device that performs a method for dynamically controlling directional 

£ processing in the multi-microphone sound processing system, one embodiment 

% H 15 of the invention includes at least the acts of: receiving first and second 

W electronic sound signals from first and second microphones, respectively; 

Q 

producing a differential electronic sound signal based on the first and second 

p sound signals when an estimated noise level is greater than a first threshold; 

III and alternatively producing a non-differential sound signal based on the first 

p 20 and second sound signals when the estimated noise level is less than greater 

! ~ than a second threshold. 

As a method for dynamically controlling directional processing in the 
multi-microphone sound processing system, one embodiment of the invention 
includes at least the acts of: receiving first and second electronic sound signals 
25 from first and second microphones, respectively; estimating a noise level 

picked up by at least one of the first and second microphones; and dynamically 
controlling the directional processing based on the estimated noise level. 

Other aspects and advantages of the invention will become apparent 
from the following detailed description taken in conjunction with the 
30 accompanying drawings which illustrate, by way of example, the principles of 
the invention. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

The invention will be readily understood by the following detailed 
description in conjunction with the accompanying drawings, wherein like 
reference numerals designate like structural elements, and in which: 

5 FIG.1 shows a typical direction processing system in a two-microphone 

hearing aid; 

FIG. 2 is a block diagram of a two-microphone directional processing 
system according to one embodiment of the invention; 

FIG. 3 is a block diagram of a minimum estimate unit according to one 
10 embodiment of the invention; 

p FIG. 4 is a block diagram of a minimum estimate unit according to 

jVj another embodiment of the invention; 

jy FIG. 5 is a block diagram of an automatic on/off control unit according to 

p one embodiment of the invention; 

IT 15 FIG. 6 is a schematic diagram of an automatic on/off control unit 

p according to one embodiment of the invention; 

^ FIG. 7 is a graph illustrating a relationship between directional 

Q processing (indicated by directional scale) and an input level for the automatic 

on/off control unit illustrated in FIG. 5; and 

20 FIG. 8 is a graph illustrating a relationship between directional 

processing (indicated by directional scale) and an input level for the automatic 
on/off control unit illustrated in FIG. 6. 



DETAILED DESCRIPTION OF THE INVENTION 

25 The invention relates to improved approaches to control directional 

processing in multi-microphone processing systems. These approaches 
operate to control activation/deactivation of directional processing in multi- 
microphone processing systems. As a result, directional processing can be 
automatically activated or deactivated based on the amount of interference 

30 (e.g., noise) in a listening environment. For instance, when the listening 
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environment is noisy, directional processing is activated, and when the listening 
environment is quiet, directional processing is deactivated. These approaches 
are particularly useful for hearing aid applications in which directional noise 
suppression is important. 

5 According to one aspect, the invention operates to measure noise level 

picked up by one or more of the microphones in a multi-microphone directional 
processing system, and then either activating the directional processing when 
the noise level is high or deactivating the directional processing when the noise 
level is low. Additionally, transitions between activation and deactivation of the 

10 directional processing can be made smoothly without annoying users. 

Consequently, the invention enables multi-microphone directional 

Jn processing systems to achieve automatic directional processing when needed 

P The invention is described below with respect to embodiments particularly well 

IxJ suited for use with hearing aid applications. However, it should be recognized 

jtj 15 that the invention is not limited to hearing aid applications, but is applicable to 

5J other sound pick-up systems. 

H; Embodiments of the invention are discussed below with reference to 

RJ FIGs. 2-8. However, those skilled in the art will readily appreciate that the 

□ 

□ detailed description given herein with respect to these figures is for explanatory 

^ 20 purposes as the invention extends beyond these limited embodiments. 

FIG. 2 is a block diagram of a two-microphone directional processing 
system 200 according to one embodiment of the invention. The two- 
microphone directional processing system 200 includes a first microphone 202 
and a second microphone 204. The first microphone 202 produces a first 

25 electronic sound signal and the second microphone 204 produces a second 
electronic sound signal. A delay unit 206 delays the second electronic sound 
signal. The two-microphone directional processing system 200 also includes a 
minimum estimate unit 208 and an automatic on/off control unit 210. The 
minimum estimate unit 208 estimates a minimum level for the first electronic 

30 sound signal. Typically, the minimum level is measured over a time constant 
duration, such that the minimum is a relatively long-term minimum. The 
automatic on/off control unit 210 produces a directional processing control 
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signal that is sent to a multiplication unit 212. The multiplication unit 212 then 
multiplies the second electronic sound signal with the directional processing 
control signal at the multiplication unit 212 to produce a processed second 
electronic sound signal. The processed second electronic sound signal is thus 
5 processed to either perform directional processing or not perform directional 
processing. In one implementation, the multiplication unit 212 scales the 
second electronic sound signal by "1" when directional processing is to be 
performed, and scales the second electronic sound signal by "0" when 
directional processing is not to be performed. A subtraction unit 214 then 
10 subtracts the processed second electronic sound signal from the first electronic 
sound signal to produce an output signal. At this point, the output signal has 
undergone directional processing by the two-microphone directional processing 
S system 200 when the noise level picked up by the first microphone 202 is 

5j sufficiently high. Such directional processing enables unwanted interference 

y 15 from certain directions to be suppressed. However, in cases where the noise 
y level picked up by the first microphone 202 is low, the two-microphone 

^ directional processing system 200 does not perform directional processing. 

□ Consequently, the disadvantages of directional processing are automatically 

ill avoided when directional processing is not beneficial. 

p 20 In this embodiment, minimum estimates and multiplication calculations 

3=80 are performed. The minimum estimates can, for example, be performed by 

minimum estimate units shown in more detail below with respect to FIGs. 3 and 
4. It should also be noted that the delay unit 206 can be positioned within the 
two-microphone directional processing system 200 anywhere in the channel 
25 associated with the second electronic sound signal prior to the subtraction unit 
214. 

The minimum level being measured by the minimum estimate unit 208 
represents an estimate of the noise level being packed-up by the first 
microphones. Although the two-microphone directional processing system 200 
30 uses minimum estimates of the electronic sound signals produced by the first 
and second microphones 202 and 204, other signal characteristics can 
alternatively be used to measure noise level. For example, Root-Mean-Square 
(RMS) average of the electronic sound signals produced by the microphones 
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could be used. With such an approach, the RMS average could be measured 
over a time constant duration. The time constant can be set such that the 
average is relatively long-term so as to avoid impact of signal fluctuations. The 
time constant with an RMS approach is likely to be longer than the time 
5 constant for the minimum approach. 

FIG. 3 is a block diagram of a minimum estimate unit 300 according to 
one embodiment of the invention. The minimum estimate unit 300 is, for 
example, suitable for use as the minimum estimate unit discussed above with 
respect to FIG. 2. The minimum estimate unit 300 receives an input signal 
10 (e.g., electronic sound signal) that is to have its minimum estimated. The input 
signal is supplied to an absolute value circuit 302 that determines the absolute 
p value of the input signal. An add circuit 304 adds the absolute value of the 

j| input signal together with an offset amount 306 and thus produces an offset 

^ absolute value signal. The addition of the offset amount, which is typically a 

£ 15 small positive value, such as 0.000000000001, is used to avoid overflow in 
j2 division or logarithm calculations performed in subsequent circuitry in the multi- 

^ microphone directional processing systems. The offset absolute value signal 

y from the add circuit 304 is supplied to a subtract circuit 308. The subtract 

jj{ circuit 308 subtracts a previous output 310 from the offset absolute value signal 

O 20 to produce a difference signal 312. The difference signal 312 is supplied to a 

multiply circuit 314. In addition, the difference signal 312 is supplied to a switch 
circuit 316. The switch circuit 316 selects one of two constants that are 
supplied to the multiply circuit 314. A first of the constants, referred to as 
alphaB, is supplied to the multiply circuit 314 when the difference signal 312 is 
25 greater than or equal to zero. Alternatively, a second constant, referred to as 
alphaA, is supplied to the multiply circuit 314 when the difference signal 312 is 
not greater than or equal to zero. The constants, alphaA and alphaB, are 
typically small positive values, with alphaA being greater than alphaB. In one 
implementation, alphaA is 0.00005 and alphaB is 0.000005. The multiply 
30 circuit 314 multiplies the difference signal 312 by the selected constant to 

produce an adjustment amount. The adjustment amount is supplied to an add 
circuit 318. The add circuit 318 adds the adjustment amount to the previous 
output 310 to produce a minimum estimate for the input signal. A sample delay 
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circuit 320 delays the minimum estimate by a delay (1/z) to yield the previous 1 
output 310 (where 1/z represents a delay operation). 

FIG. 4 is a block diagram of a minimum estimate unit 400 according to 
another embodiment of the invention. The minimum estimate unit 400 is, for 
5 example, similar in design to the minimum estimate unit 300 illustrated in FIG. 
3. The minimum estimate unit 400, however, further includes a linear-to- 
logarithm conversion unit 402 that converts the offset absolute value signal into 
a logarithmic offset signal before being supplied to the subtract circuit 308. The 
minimum estimate unit 400 is, for example, suitable for use as the minimum 
10 estimate unit discussed above with respect to FIG. 2. Optionally, a logarithm- 
to-linear conversion could be performed at the output of the minimum estimate 
circuit 400. 

The two constants, alphaA and alphaB, are used in the minimum 
estimate units 300, 400 to determine how the minimum estimate changes with 
15 the input signal. Because the constant alphaA is greater than the constant 
alphaB, the minimum estimate tracks the valley level (or minimum level) of the 
input signal. Since the valley level is typically a good indicator of the noise 
level in the sound, the minimum estimate produced by the minimum estimate 
units 300, 400 is a good indicator of background noise level. 

20 FIG. 5 is a block diagram of an automatic on/off control unit 500 

according to one embodiment of the invention. The automatic on/off control 
unit 500 is, for example, suitable for use as the automatic on/off control unit 210 
illustrated in FIG. 2. The automatic on/off control unit 500 includes a subtract 
circuit 502 and a subtract circuit 504. The subtract circuits 502 and 504 receive 

25 an input signal. The input signal, for example, represents the minimum 

estimate, such as the minimum estimate produced by the minimum estimate 
unit 208 illustrated in FIG. 2. The subtract circuit 502 also receives a second 
level setting (L2), and the subtract circuit 504 receives a first level setting (L1). 
The second level setting (L2) is greater than the first level setting (L1). The first 

30 level setting (L1) and the second level setting (L2) can be referred to as 
threshold amounts, levels or values. The subtract circuit 502 subtracts the 
second level setting (L2) from the input signal to produce a first control signal 
that is supplied to a switch circuit 506. The subtract circuit 504 subtracts the 
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input signal from the first level setting (L1) to produce a second control signal 
that is supplied to switch circuit 508. Note that the input signals to the 
automatic on/off control unit 500 pertains to a noise level picked-up by one or 
more of the microphones. When the first control signal indicates that the input 
5 signal (i.e., noise level) is greater than the second level setting (L2), the switch 
circuit 506 causes a constant "1" value to be supplied as an output of the 
automatic on/off control unit 500. Alternatively, when the switch circuit 508 
determines that the second control signal is less than the first level setting (L1), 
the switch circuit 508 outputs a "0" value which is passed through the switch 
10 circuit 506 and thus forms the output. The output of the automatic on/off 

control unit 500 is also coupled to a sample delay circuit 510 that subjects the 
output signal to a delay on the order of one sample. In other words, the sample 
5 delay circuit 51 0 delays the output signal by a delay (1/z) to yield a previous 

output (or delayed output) (where 1/z represents a delay operation). The 
15 previous output is fed back as another input to the switch unit 508. Hence, 
when the input signal to the automatic on/off control unit 500 is between the 
first level setting (L1) and the second level setting (L2), the output signal is held 
in its previous state. In other words, the delayed output produced by the 
sample delay circuit 510 is passed back through the switch circuit 508 and then 
20 through the switch circuit 506 to again become the output. 

FIG. 6 is a schematic diagram of an automatic on/off control unit 600 
according to one embodiment of the invention. The automatic on/off control 
unit 600 is, for example, also suitable for use as the automatic on/off control 
unit 210 illustrated in FIG. 2. The automatic on/off control unit 600 includes a 
25 subtract circuit 602. The subtract circuit 602 receives an input signal to the 
automatic on/off control unit 600. The input signal represents the noise level 
picked up by one of the microphones, such as one of the microphones 202 and 
204 illustrated in FIG. 2. The subtract circuit also receives a reference level (L). 
The reference level (L) can be referred to as a threshold amount, level or value. 
30 The subtract circuit 602 subtracts the reference level (L) from the input signal to 
produce a value indicating the extent to which the input signal exceeds the 
reference level (L). This difference signal is then scaled by a scaling circuit 
604. As an example, the scaling circuit can scale down the difference signal by 



s 3 ^ 
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20% (0.05). The scaled difference signal produced by the scaling circuit 604 is 
then passed through a limit circuit 606 so that a resulting output signal has its 
amplitude limited to a value between 0 and 1 . 

FIG. 7 is a graph illustrating a relationship between directional 
5 processing (indicated by directional scale) and an input level for the automatic 
on/off control unit 500 illustrated in FIG. 5. FIG. 7 indicates that a smooth 
transition between directional processing "on" and directional processing "off" is 
achieved. In effect, the transitioning between directional processing "on" and 
directional processing "off" enjoys a hysteresis characteristic to prevent rapid 
10 oscillations in switching directional processing "on" and "off". More particularly, 
the first level setting (L1) is a constant that determines when to absolutely turn- 
off the directional processing, and the second level setting (L2) is a constant 
JjJ that determines when to absolutely turn-on the directional processing. When 

P? input signal (e.g., noise level) is less than the first level setting (L1), the 

W 15 directional scale is zero ("0") and directional processing is turned off. When the 

I?™ 

55 input is greater than the second level setting (L2), the directional scale is one 

3 ~ ("1") and the directional processing is turned on. When the input is between 

O the first level setting (L1) and the second level setting (L2), the directional scale 

does not change. That is, if the directional processing was "on" previously, it 
20 should stay "on". If the directional processing was "off' previously, it should 
stay "off". It is desirable to set the second level setting (L2) to be greater than 
the first level setting (L1). This is because the noise level usually does not vary 
much in a short time, thus setting the second level setting (L2) to be greater 
than the first level setting (L1) guarantees that the estimate variation of noise 
25 level by the "minimum estimate" will not frequently trigger the directional 
processing "on" and "off 1 . Therefore, a smooth transition between the two 
stages is achieved. 

FIG. 8 is a graph illustrating a relationship between directional 
processing (indicated by directional scale) and an input level for the automatic 
30 on/off control unit 600 illustrated in FIG. 6. When the input level is less than the 
reference level (L) (threshold level), the directional processing is completely 
"off". As the input level exceeds the threshold level, the directional processing 
is gradually performed more and more as the input level increases up to the 
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condition in which the directional processing is completely "on". More 
specifically, if the input signal (e.g., noise level) is less than the "threshold", the 
directional scale is zero and the directional processing is turned "off". If the 
input signal is greater than the "threshold", the directional scale gradually 
5 increases as the input level goes up. The rate of the increase is determined by 
the scaling rate of the scaling circuit 604. If directional scale is one, the 
directional processing is fully "on". If the directional scale is less than one but 
greater than zero, directional processing is on but less effective. Because the 
directional processing is gradually switched in as the noise level increases, the 
10 small variation in the noise estimate will not cause great change in the nature of 
the directional processing and therefore, the transition between directionality on 
and off is perceptually smooth. 

2 The invention can also be combined with other inventions so as to share 

fj circuitry or otherwise complement one another. For example, the invention 

W 15 described herein can be combined with adaptive null processing techniques 
y described in U.S. Application No. 09/788,271, filed February 16, 2001, and 

p entitled "NULL ADAPTATION IN MULTI-MICROPHONE DIRECTIONAL 

Q SYSTEM", the contents of which is hereby incorporated by reference, and/or 

m the adaptive microphone sensitivity matching described in U.S. Application No. 

5 20 09/ , filed March 14, 2001 , and entitled "ADAPTIVE MICROPHONE 

U MATCHING IN MULTI-MICROPHONE DIRECTIONAL SYSTEM", the contents 

of which is hereby incorporated by reference. 

The invention is preferably implemented in hardware, but can be 
implemented in software or a combination of hardware and software. The 

25 invention can also be embodied as computer readable code on a computer 

readable medium. The computer readable medium is any data storage device 
that can store data which can be thereafter be read by a computer system. 
Examples of the computer readable medium include read-only memory, 
random-access memory, CD-ROMs, magnetic tape, optical data storage 

30 devices, carrier waves. The computer readable medium can also be distributed 
over a network coupled computer systems so that the computer readable code 
is stored and executed in a distributed fashion. 
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The advantages of the invention are numerous. Different embodiments 
or implementations may yield one or more of the following advantages. One 
advantage of the invention is that directional processing to aid in interference 
suppression is automatically controlled. Another advantage of the invention is 
that directional processing is deactivated when not beneficial. Still another 
advantage of the invention is that directional processing is done in a manner 
that is perceptively smooth to the user. 

The many features and advantages of the present invention are 
apparent from the written description and, thus, it is intended by the appended 
claims to cover all such features and advantages of the invention. Further, 
since numerous modifications and changes will readily occur to those skilled in 
the art, it is not desired to limit the invention to the exact construction and 
operation as illustrated and described. Hence, all suitable modifications and 
equivalents may be resorted to as falling within the scope of the invention. 

What is claimed is: 
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